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Ijj? (57) Abstract: Predicting a reflectance spectrum of a photographic print based on data from a scanned color negative. The technique 
uses dye concentration, providing a channel -independent basis for the spectral model. The spectral model includes three conceptual 

^ sections: scanner and film models, a photographic printer model, and a photographic paper model. The scanner and film section 
converts digital data from a scan of a color negative on a calibrated scanner into predictions of the spectral transmittance for each 
pixel. The photographic printer section uses an exposure schedule and optionally a color temperature and computes the spectrum of 
the exposing illumination as a function of time. The photographic paper section converts the illuminated negative's spectral power 

^ first into dye concentration estimates and subsequently into a predicted reflectance spectrum for the simulated print. 
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SPECTRAL MODELING OF PHOTOGRAPHIC PRINTING 
BASED ON DYE CONCENTRATION 

TECHNICAL FIELD 

. The invention relates to modeling : photographic printing, and I 5^ e J^ I ] t ^ cu ^ a ^y to _ 

modeling the process and apparatus for making a photographic print based on a 
photographic color negative. 
5 BACKGROUND 

Photographic printing produces a photographic print from a photographic 
negative. In the photographic printing process various factors combine to produce the 
resulting photographic print, including characteristics of the exposure illuminant and 
process, the print paper, and dyes. To accurately characterize a photographic print 

1 0 with a photographic printing model, each of these real aspects of the printing process 
needs to be modeled. 

A scanner can be used to scan a photographic color negative and generate 
corresponding digital output values. Scanners produce digital output values to 
represent the spectral transmittance of an input sample. A typical scanner illuminates 

15 a transmissive target using a light source. The scanner integrates light that passes 
through the sample and passes through a set of spectrally selective filters. The 
integrated products may be modified by electronics and software to obtain digital 
output values. These digital output values can be combined with print and dye models 
to characterize photographic media. However, conventional photographic 

20 characterizations are based on density and are not channel independent. A channel 
independent characterization would provide a more flexible model. 

In addition, different reflectance spectra can be perceived by the eye as the same 
color. Similarly, different spectra can produce the same digital values. This effect is 
called "metamerism." Metameric samples can produce different colorimetric 

25 response values when viewed or scanned under different viewing conditions. As a 

result, in modeling scanners, many different reflectance spectra can produce the same 
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RGB values. To determine a more accurate estimate of a reflectance spectrum, it is 
desirable to limit the candidates to avoid metameric matches. 

SUMMARY 

5 The invention provides methods and apparatus implementing a technique for 

predicting a reflectance spectrum of a photographic print. The technique models the 
print based on data from a source image, such as a color negative or color positive. 
The technique is also applicable to modeling an output image on transmissive media. 
The data is preferably obtained from an image acquisition device such as a scanner or 
10 digital camera. The technique uses dye concentration, providing a 

channel-independent basis for the spectral model. When used in combination with a 
color management system, the technique allows for previewing or manipulation of 
photographic images or experimentation with photographic processes via simulation. 
The user can control the simulated processing with an exposure schedule and optional 
1 5 print illuminant color temperature that controls the exposure time and spectral content 
of the printing illuminant. The user can also control other aspects of the simulated 
processing by modifying parameters such as the color filters, the illuminant spectrum, 
and the spectral sensitivities or absorption spectra of the paper. 

The preferred spectral model includes three conceptual sections: scanner and film 
20 models, a photographic printer model, and a photographic paper model. The scanner 
and film section converts digital data from a scan of a color negative on a calibrated 
scanner into predictions of the spectral transmittance for each pixel. In alternative 
implementations, the scanner model is replaced with alternative models of image 
acquisition devices. The photographic printer section uses an exposure schedule and 
25 optionally a color temperature and computes the spectrum of the exposing 

illumination as a function of time. The photographic paper section converts the 
illuminated negative's spectral power first into dye concentration estimates and 
subsequently into a predicted reflectance spectrum for the simulated print. 

In general, in one aspect, the technique includes: converting digital values from 
30 scanning a photographic negative to a film transmittance spectrum using a 
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photographic negative film model corresponding to a media of the photographic 
negative; estimating an exposure illumination spectrum over time using an exposure 
schedule; estimating paper spectral sensitivities of a photographic paper 
corresponding to the photographic print; integrating over time spectral products of 
5 the film transmittance spectrum, the exposure illumination spectrum, and the paper 
spectral sensitivities; converting the integrated spectral products into log integrated 
exposures; converting the log integrated exposures to dye concentrations; and 
converting the dye concentrations to a predicted reflectance spectrum. 

Advantages that may be seen in implementations of the invention include one or 

10 more of the following: computation based on dye concentration is simple and direct; 
the predicted spectrum is an accurate model of photographic media and the 
development process; the model enables realistic proofing, preview, and global or 
selective manipulation of photographic images without physically exposing and 
developing a photographic print from a negative; experimentation with new 

1 5 algorithms for automatic color correction and investigation of material properties or 
printer characteristics are facilitated; and the determination of complex parameters is 
improved by using targets which are easy to produce and measure. Furthermore, 
given accurate parameters in the model, physical constraints of the photographic 
printing process may be relaxed and images better than those which are produced via 

20 analog printing may be obtained. For example, adjusting exposure range compression 
can avoid blocked-up shadows and burned-out highlights, and exposures that ignore 
secondary effects can result in more vibrant images. In addition, the simulated 
processing can be implemented as a computer program to provide a virtual 
photographic printer apparatus, complete with software controls mimicking those of 

25 real apparatus. 

DESCRIPTION OF DRAWINGS 

FIG. 1 is a block diagram of interaction of models according to an embodiment of 
the invention. 
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FIG. 2 is a flow chart of predicting a reflectance spectrum according to an 
embodiment of the invention. 

FIG. 3 is a block diagram of scanner and film models. 
FIG. 4 is a flow chart of an inverse model of the scanner model. 
5 FIG. 5 A is a flow chart of a forward scanner model. 

FIG. 5B is a flow chart of an alternative implementation of a forward scanner 
model. 

FIG. 6 is a flow chart of estimating parameters for the inverse model. 

FIG. 7 is a graph of the spectral reflectance of a target with a neutral color wedge. 
1 0 FIG. 8 A is a flow chart of estimating parameters for the inverse model. 

FIG. 8B is a flow chart of estimating parameters for the inverse model. 

FIG. 9 is a block diagram of a photographic printer model. 

FIG. 10 is a flow chart of the photographic printer model. 

FIG. 1 1 is an example of an exposure schedule. 
1 5 FIG. 1 2 is a block diagram of a photographic paper model. 

Like reference numbers and designations in the various drawings indicate like 
elements. 

DETAILED DESCRIPTION 

20 In one embodiment of the invention, a computer system predicts the reflectance 

spectrum of a photographic print based on a photographic negative. As shown in FIG. 
1 , in a spectral model 1 00 of a photographic printing process, the computer system 
employs scanner and film models 105, a photographic printer model 110, and a 
photographic paper model 115. The models 105, 1 10, 1 15 can be implemented as 

25 logically or physically separate components or can be implemented as a single 
component where the models are distinct only as abstractions. As a result, the 
allocation of calculations and equations described below is one exemplary 
implementation among numerous possibilities. The scanner and film models receive 
target digital values produced by scanning the photographic negative (i.e., acquiring 

30 and processing image information based on spectral energy received from the 
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illuminated sample) using a scanner (not shown) and convert those values, on a 
per-pixel basis, to a film transmittance spectrum. Alternatively, the scanner model 
105 uses a color look-up table to determine the target digital values. In an alternative 
implementation, the scanner model 105 is replaced with a different model of an image 
5 acquisition device, such as a digital camera model or a different scanner model. 

Examples of other spectral scanner models include those described by R.S. Berns and 
M.J. Shyu in "Colorimetric Characterization of a Desktop Drum Scanner using a 
Spectral Model," Journal of Electronic Imaging, Vol. 4, No. 4, October 1995, pp. 
360-72; by Dunne et al., in U.S. Patent No. 5,149,960, Sept. 1992; by C.E. Mancil, in 
10 Digital Color Image Restoration, Ph.D. thesis, Univ. of S. Calif, Aug. 1975; and by 
Sherman, in U.S. Patent No. 5,543,940, Aug. 1996. In another alternative 
implementation, a transmission spectra corresponding to a color negative can be 
obtained by direct measurement, such as with a scanning transmissive 
spectrophotometer. 

15 The photographic printer model 1 1 0 models the spectrum of an illuminant over 

time. The photographic printer model 1 10 estimates an exposure illumination 
spectrum over time according to an exposure schedule. The exposure schedule can be 
supplied by a user or determined automatically, such as by using statistics of the 
scanned negative data. The photographic paper model 1 1 5 models the dye absorption 

20 and reflectance of a particular photographic paper. The photographic paper model 115 
converts the film transmittance spectrum, the exposure illumination spectrum, and 
paper spectral sensitivities corresponding to the photographic paper to dye 
concentrations. The photographic paper model 115 also converts the dye 
concentrations to a predicted reflectance spectrum. The predicted reflectance 

25 spectrum represents a reflectance spectrum of a photographic print which would result 
from developing the scanned photographic negative using the photographic printing 
device and paper modeled in the spectral model 100. Each of the models is described 
in more detail below. 

As shown in FIG. 2, in a method 200 of predicting the reflectance spectrum of the 
30 photographic print, the computer system converts digital values from scanning the 
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photographic negative to a film transmittance spectrum (step 205). The photographic 
negative is preferably a color negative, but alternatively can be a grayscale (e.g., black 
and white) negative, or color or grayscale positive. To convert the digital values, the 
computer system uses a photographic negative film model corresponding to the 
5 photographic negative media. The computer system uses a user-supplied exposure 
schedule and a model of a photographic printer to estimate an exposure illumination 
spectrum over time (step 210). The computer system may optionally also use a color 
temperature to estimate the exposure illumination spectrum. The computer system 
estimates paper spectral sensitivities corresponding to a photographic paper (step 

10 215). Alternatively, the paper spectral sensitivities can be supplied or pre-determined. 
The computer system integrates spectral products of the film transmittance spectrum, 
the exposure illumination spectrum, and the paper spectral sensitivities (step 220). 
The computer system converts the integrated spectral products to log integrated 
exposures (step 225) and converts the log integrated exposures to dye concentrations 

1 5 (step 230). To complete the process, the computer system converts the dye 
concentrations to a predicted reflectance spectrum (step 235). 

Scanner and Film Models 

In one implementation of the models of the scanner and photographic negative, a 
20 computer system models the colorimetric behavior of a graphics arts scanner when 

scanning a sample, i.e. , the photographic negative. As shown in FIG. 3, the computer 
system employs an inverse model 300 which converts target digital values from 
scanning a photographic color negative to an estimated spectrum. The scanner has at 
least one output channel (e.g. , R, G, and B) and generates target digital values for 
25 each channel. The estimated spectrum can be an estimate of spectral reflectance or 
spectral transmittance, depending upon the application. The inverse model 300 
includes a forward model 305 which estimates digital values for each channel of the 
scanner based on a supplied spectrum. The inverse model also includes a media 
model 310 particular to the media of the sample which translates media coordinates 
30 into an estimated spectrum. The media model can be for reflective or transmissive 



PCT/USOO/15469 

WO 01/01672 

media. For a photographic color negative, the media model is a photographic color 
negative film model corresponding to the particular media of the photographic 
negative. The media model 310 receives color negative dye absorption spectra to 
model the dye absorption of the photographic negative. The negative dye absorption 
5 spectra can be supplied from the film manufacturer or estimated as described below. 

The inverse model 300 repeatedly estimates coordinates in a colorant space 

corresponding to the photographic negative using a search engine 3 1 5 . The search 
engine 3 1 5 searches in the colorant space based on an error value 320 between target 
digital values from the scanner and estimated digital values from the forward model 
10 305. The inverse model 300 converts estimated media coordinates to an estimated 
spectrum through the media model 3 1 0 and supplies the estimated spectrum to the 
forward model 305. The forward model 305 converts the supplied spectrum to 
estimated digital values. The inverse model 300 compares the estimated digital values 
to the target digital values to find the error value 320. If a stopping criterion or criteria 
1 5 have not been met, the search engine 3 1 5 searches for new media coordinates based 
on that error value 320 and the process repeats. The stopping criterion can be a 
specified tolerance for the error value 320, or alternatively can be a different criterion 
such as a number of iterations. When the stopping criterion has been met, the inverse 
model 300 recognizes that spectrum as the spectrum which sufficiently corresponds to 
20 the transmittance spectrum of the photographic negative. 

As shown in FIG. 4, in a method 400 of modeling the spectral reflectance of a 
photographic negative as scanned by a scanner by identifying a predicted spectrum, a 
computer system estimates media coordinates in a colorant space of a media model 
corresponding to the photographic negative (step 405). The computer system 
25 estimates the media coordinates based on target digital values produced by the 

scanner. The estimated media coordinates are estimated to correspond to a spectrum 
which produces the target digital values. For example, the media coordinates for 
conventional color negative film represent the concentrations of cyan, magenta, and 
yellow dyes. The estimation of the initial media coordinates is not critical. The 
30 inverse model should converge to an acceptable solution even for "poor" initial 
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estimates. The possibility of converging to an incorrect metameric match is reduced, 
however, when the initial estimates are close to their final values. One process for 
estimating initial media coordinates uses constant initial values from the center of the 
valid ranges for the media coordinates. An alternative process uses the target RGB 
5 values from the scanner or their inverted values as the initial estimates. For example, 
in one implementation the media model represents media with cyan, magenta, and 
yellow dyes and all media coordinates and target device values are normalized to a 
range of zero to one. In this case, initial media coordinates can be computed as the 
inverted target RGB values: 

10 Co=l'Rtgt 
Mo-l-Gtgt 

where Co, Mo, and Yo are the initial estimated media coordinates and Rfgt, Gfgu and 
B t gt are the target RGB values. Other processes for estimating the initial media 

1 5 coordinates are possible and should be obvious to one of ordinary skill in the art. 

The computer system converts the estimated media coordinates to an estimated 
spectrum using a spectral media model (step 410). As noted above, the media model 
is specific to the media of the photographic negative. The computer system selects 
media coordinates which are within the colorant space of the media model. 

20 Accordingly, the media model limits the spectra under consideration and its use thus 
limits the resulting metamerism (i.e., different spectral values which appear to 
produce the same color to a particular viewer or device) in estimating the media 
coordinates. The media model reduces the metamerism problem by constraining the 
coordinates to compute spectra which are observable on the media according to 

25 supplied or measured dye absorption spectra for the film, eliminating from 

consideration metameric spectra which the media cannot produce. In addition, the 
media colorant space has fewer dimensions than a spectral measurement and so 
searching over the media colorant space is more efficient. For example, where the 
media colorant space is CMY, the media colorant space has three dimensions. A 
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measured spectrum typically has a large number of spectral wavelengths or bands, 

such as 16, 31, or 36. 

For color negative film, the media model uses the Beer-Bouguer theory to 
describe the relationship between dye concentration and spectral transmittance. The 
5 Beer-Bouguer theory is described by Berns. This model may be expressed as: 

T»(A) = T g a) exp[-{cK c (A) + mK m (X) +yK y (X)}] 

where c, m, and y are the dye concentrations, X represents wavelength, K C (X), K m (A), 
1 0 and K y (k) are normalized spectral dye absorptivities, T g (X) is the spectral 

transmittance of the film base, and T n (X) is the spectral transmittance of a color patch. 
Unexposed film may not represent the true film base nor the maximum transmittance 
in a given spectral band due to the presence of masking couplers. Overmasking {i.e., 
film production defects that create the possibility, for example, for a strong red 
15 exposure to produce cyan dye concentration lower than that of the unexposed film 
base) and other effects may cause transmission in some spectral bands of particular 
colors to exceed that of the unexposed film. In evaluation of film models derived 
from either unexposed film or the maximum transmittance as the film base, however, 
there is little difference in their ability to reproduce measured color negative 
20 transmission spectra. Accordingly, the unexposed film transmission spectrum is 
preferred as the film base transmittance because the unexposed film transmission 
spectrum is smoother. 

For media that are not digitally addressed, including color negative film, 
producing single-dye exposures for determination of each dye's absorption spectrum 
25 is often difficult. Statistical methods such as factor analysis are preferred to determine 
the colorants' absorption spectra. E.R. Malinowski and D.G. Howery describe a 
method of factor analysis in "Factor Analysis in Chemistry", John Wiley & Sons, 
New York, 1980, ch. 3. Application of factor analysis to modeling media involves a 
principal component analysis applied to absorption spectra from a set of media color 
30 samples followed by a rotation of the principal directions. The principal component 
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analysis results in directions defining a lower-dimensional space completely 
describing the sample data variance. Rotation of the principal components attempts to 
distribute the variance equally among the components, often resulting in factors with 
physical significance, such as individual colorant absorption spectra. 
5 Preferably, factor analysis is applied to absorption spectra from color negative 

samples that span the gamut of a film recorder. The absorption spectrum K} m i x (X) of 
the Mh sample is computed from the measured transmission spectrum T* n (A) and may 
be expressed as: 

^w-in/nw/r;w; 

10 Principal component analysis produces one eigenvector for each colorant in the film. 
Thus, for color negative film, the principal component analysis produces three 
eigenvectors, one for each of the cyan, magenta, and yellow dyes. These vectors are 
transformed using a target rotation described in Malinowski. Normalized absorption 
spectra from step wedges for each channel of the film recorder are used as aim spectra 

15 (i.e., the target vectors for the target rotation). Manual adjustment can be used to 

modify the target absorption spectra. Such adjustment may be used to compensate for 
the fact that the step-wedge samples are not single-dye exposures. The rotated vectors 
preferably are capable of reproducing substantially the entire absorption data set. In 
order to improve this reproduction, the vectors may require negative concentrations 

20 (often with magnitudes of 5% or less of the maximum concentration). The rotated 

spectra may also include negative absorption regions to reproduce the training set of 
samples. By constraining the film model's concentrations, the bipolar nature of the 
concentration is not problematic. 

Receiving the estimated spectrum from the media model, the computer system 

25 converts the estimated spectrum to estimated digital values using a forward model of 
the scanner (step 415). The computer system supplies the estimated spectrum to the 
forward model and the forward model predicts digital values the scanner would 
produce for the supplied spectrum in the device-dependent coordinate space of the 
scanner. The forward model includes filter functions and channel-independent tone 

30 reproduction curves ("TRCs") which are specific to the scanner. The forward model 
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optionally includes correction functions to represent channel interaction unaccounted 
for in other sections of the forward model. The forward model is described in more 
detail below. 

The computer system calculates an error value between the target digital values 
5 and the estimated digital values (step 420). The computer system preferably calculates 
the Euclidean distance between the two- sets of digital values. The error value can be a 
composite error value, including the digital values for all the channels/or an error 
value particular to each digital value. Alternatively, the calculation of the error value 
may vary for each digital value. If a specified stopping criterion has been met, the 
10 estimated spectrum which produced the current estimated digital values is output as 
the predicted spectrum (step 425). The stopping criterion can be an error tolerance. In 
one alternative implementation, each digital value has a different tolerance. In such an 
implementation, the estimated spectrum is the predicted spectrum when each of the 
errors is less than the corresponding tolerance. If the stopping criterion has not been 
1 5 met, the computer system "searches" the colorant space of the media model by 

updating the current media coordinates based on the error to determine new media 
coordinates (step 430). The search engine preferably maintains statistics of the 
estimated media coordinates and errors to determine an "error surface" model. The 
search engine uses the accumulated error surface model and the current error to 
20 determine new estimated media coordinates. The search engine preferably uses a 
numerical minimization technique such as Powell's method or BFGS described by 
W.H. Press et al. in "Numerical Recipes in C", 2d ed., Cambridge University Press, 
1992. This technique is further constrained so that only media coordinates within 
bounds corresponding to the media model are identified. Thus, the media model 
25 restricts the search process, reducing metamerism. The computer system passes the 
new media coordinates through the media model (step 4 1 0) and repeats these steps 
until the stopping criterion has been met. 

As shown in FIG. 5A, in a forward model 500, the computer system receives a 
sample spectrum, such as the estimated spectrum supplied by the inverse model. The 
30 sample spectrum is multiplied 505 by filter functions 5 1 0 corresponding to each 
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channel of the scanner. In an implementation where the scanner has red, green, and 
blue channels, the forward model includes three filter functions, as shown in FIG. 5A. 
Each filter function 510 represents the product of a filter transmittance spectrum and 
an illuminant spectrum. The filter transmittance and illuminant spectra need not be 
separately determined. Alternatively, the illuminant spectrum can be provided or 
measured directly, as described below. The filter functions 510 are estimated from 
training samples, as described below. The products of each filter function and the 
sample spectrum sire integrated 515 over at least one wavelength, such as the visible 
wavelengths, preferably approximately 380 to 730 nanometers. The integrator outputs 
thus may be expressed as: 

r= J S(X)R(X)l(X)dX 
g= J S(X)G(X)I(X)dX 
b = J S(X)B(X)I(X)dX 

where r, g, and b are the integrator outputs; S is the sample spectrum; i?, G, and B are 
the filter transmittance spectra; / is the illuminant spectrum; and X represents 
wavelength. As noted above, R, G, B, and / may be expressed as filter functions: 

F R (X) = R(X)I(X) 
. F G (X) = G(X)I(X) 
F B (X) = B(X)1(X) 

The forward model 500 converts the integrator outputs to digital values using tone 
reproduction curves ("TRC") 520. The TRCs 520 are one-dimensional 
transformation functions, such as gain-offset gamma functions, and may be expressed 
as: 

d r = T R [r] = [ k gat n, r + k oJ fse,.r Y* 
d g = T C fgj = [ k g ain.* g + kojffse, g T* 
dt = Tb [b] = [ k g ain.t b + ko&ei.b f* 
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The forward model 500 may optionally adjust these digital values from the TRCs 520 
using correction functions 525, as described below. 

FIG. 5B shows an implementation of a forward model 550 where the illuminant 
spectrum is known or measured directly. The operation of the forward model 550 is 
5 generally similar to that of the forward model 500 shown in FIG. 5 A and described 
"above/The received sample spectrum is multiplied 552 by the supplied illuminant - 
spectrum. This product is multiplied 555 by filter transmittance spectra 560 
corresponding to each channel of the scanner. In an implementation where the scanner 
has red, green, and blue channels, the forward model includes three filter 
1 0 transmittance spectra, as shown in FIG. 5B. The filter transmittance spectra 560 are 
estimated from training samples using the known illuminant spectrum. Thus, rather 
than estimating filter functions which represent the products of filter transmittance 
spectra and an illuminant spectrum as in the forward model 500 of FIG. 5 A, the filter 
transmittance spectra 560 are estimated directly. As above, the resulting products are 
15 integrated 565 over the visible wavelengths, preferably approximately 380 to 730 

nanometers, and the integrator outputs are converted to digital values TRCs 570. The 
forward model 550 may optionally adjust these digital values from the TRCs 570 
using correction functions 575, as described below. 

Before the computer system uses the inverse model to predict the spectral 
20 reflectance of the photographic negative, the computer system estimates the 

parameters of functions within the forward model. As shown in FIG. 6, in a process 
600 of estimating parameters, a target having a neutral step wedge is scanned to 
produce flat sample values (step 605). The neutral step wedge target preferably has 
reflectance spectra which are substantially flat and a density range which 
25 encompasses the density range of most imagery to be digitized by the scanner. The 
spectra of the target are also measured with a spectrophotometer to produce flat 
sample spectra (step 607). The spectrophotometer is either reflective or transmissive 
depending upon the nature of the media. 

An example of reflectance spectra 700 from a preferred flat spectra target is 
30 shown in FIG. 7. The flat lines 705 are average spectral values for the measured 
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values 710 for each patch over the visible wavelengths (approximately 400 to 700 
' nm). 

For the 2-th sample in the flat spectra target, the corresponding measured 
reflectance spectrum Sj is approximated by a constant, c/ 5 computed by averaging the 
5 reflectance spectrum Sj over the visible wavelengths. Accordingly, the integrals 
described above can be rewritten as (taking r as an example): 

r/= Ci\ F R (X)dX 

The integral in this equation is also a constant, O, independent of the sample spectrum 
Sj. Therefore the TRC for r can be rewritten as: 

10 dr = Tr frj = Tr[ d = [ k gain . r d <& + koffse,r T' 

By defining a new gain parameter k=g a j nr = kgain.r®* then 

d' r = T * R [d] = [k 'zain r Ci + kqffsetr T ' 

Because 5/ is substantially flat, this equation does not depend on wavelength and so 
the TRC function can be sampled at the constant c/. The resulting samples preferably 

15 are used to estimate the parameters of the one-dimensional transformation functions 
with a constrained minimization technique using the flat sample values (step 610). 
This estimation can be an iterative process which repeats until a specified criterion 
has been met. When a one-dimensional transformation function is a 
gain-offset-gamma function, the parameters are gain, offset, and gamma. The gain 

20 parameter may be too high by a factor of <X>, but this discrepancy may be compensated 
for by an implicit scale factor introduced when estimating filter function parameters. 
The TRC parameters are preferably estimated on a channel-independent basis. 

To estimate the filter parameters of the filter functions, a second multicolor target 
including color samples that span the gamut of a particular printing device is scanned 

25 to produce multicolor sample values (step 615). Reflectance spectra of the multicolor 
target are also measured to produce multicolor sample spectra (step 620). The filter 
functions are preferably approximated in the forward model by Gaussian functions 
with three parameters: mean, standard deviation, and amplitude. Alternatively, other 
functions may be used, such as cubic splines, blobs, summed Gaussians, delta 
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functions, or a combination thereof. For example, for a fluorescent illuminant, a 
combination of delta and Gaussian functions is preferred. An eight-step sampling of 
RGB color space (a total of 512 samples) may produce sufficient accuracy. 
Alternatively, fewer samples may be used. Given the estimated TRCs, as described 
5 above, a constrained minimization technique is preferably used to estimate the filter 
parameters (step 625). The estimated filter parameters minimize -the average.color .. 
difference between values produced by scanning the multicolor target and values 
predicted using the estimated filter functions and the measured spectra of the 
multicolor target. The computer system calculates filter digital values based on the 
1 0 measured spectra of the multicolor target using the forward model and the estimated 
TRC and filter functions (step 630). In this estimation, the correction functions 
preferably are not used. The system calculates a filter difference by comparing the 
filter digital values to the multicolor sample values from scanning the multicolor 
target (step 635). The filter difference is an average color difference, preferably 
1 5 calculated by finding the average Euclidean distance between paired values. If a filter 
stopping criterion is met, such as when the filter difference is within a specified filter 
tolerance (step 640), estimating the filter parameters is complete (step 645). If not, 
such as when the filter difference is outside the filter tolerance (step 640), the 
computer system re-estimates the filter functions (step 650) and repeats the above 
20 steps 630 to 640. As with the TRCs, the filter parameters are preferably estimated on 
a channel-independent basis. 

In an alternative implementation, the TRC and filter function parameters are 
estimated repeatedly in a construction process until a convergence criterion is met. 
This convergence criterion can be met when a construction difference is within a 
25 construction tolerance, or, alternatively, after a specified number of iterations. As 
shown in FIG. 8A, in an iterative parameter estimation process 800, the TRC 
parameters are estimated as described above (step 805). The TRC functions can 
alternatively be initialized as linear functions. Filter parameters are estimated as 
described above, including scanning and measuring spectra of a multicolor target 
30 (step 810). The filter functions can alternatively be initialized as conventional R, G, 
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and B filter functions, such as wide band Gaussians centered at 450, 550, and 650 
nanometers. The computer system estimates construction digital values with the 
forward model using the estimated TRC functions and filter functions based on 
measured spectra of a multicolor target, such as the multicolor target (step 815). A 
5 construction difference between these construction digital values and the digital 
values from scanning the multicolor target is calculated (step 820). If the 
convergence criterion has been met, such as when the construction difference is 
within the construction tolerance, the computer system is ready to model the scanner 
with an actual sample (step 825). If not, such as when the construction difference is 
10 outside the construction tolerance, the computer system re-estimates the TRC and 
filter parameters. The estimated filter parameters are used to re-estimate the TRC 
parameters (step 830). The filter functions are also re-estimated using the re-estimated 
TRC functions, as described above (step 835). The re-estimated TRC and filter 
functions are used to calculate new construction digital values (step 815). The 
1 5 process repeats until the construction difference is within the construction tolerance. 
Alternatively, the computer system also uses correction equations, such as stepwise 
multiple linear regression functions, to further refine the forward model predictions. 

In another alternative implementation where the TRC and filter function 
parameters are estimated repeatedly in a construction process until a convergence 
20 criterion is met, the TRC parameters and filter parameters are derived from training 
targets measured with a spectrophotometer. The convergence criterion can be met 
when a construction difference is within a construction tolerance, or, alternatively, 
after a specified number of iterations. As shown in FIG. 8B, in an iterative parameter 
estimation process 850, TRC and filter function training targets, such as the flat and 
25 multicolor targets described above, are scanned and measured with a 

spectrophotometer (step 855). The computer system determines average (constant) 
values for the TRC training spectra (step 860). The computer system estimates the 
TRC parameters using the constant values for the TRC training spectra (step 865). 
The computer system preferably estimates the TRC parameters using a constrained 
30 minimization technique. The computer system derives the filter parameters using the 
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measured training samples and constrained minimization (step 870). The computer 
system replaces the constant TRC training spectra with the actual spectral 
measurements and re-estimates the TRC parameters (step 875). The computer system 
uses the re-estimated TRC parameters to re-estimate the filter parameters (step 880). 
5 The computer system estimates construction digital values with the forward model 
- us i n g the estimated TRC functions and filter functions based on the measured spectra 
of the multicolor target (step 885). A difference between these construction digital 
values and the digital values from scanning the target is calculated (step 890). If the 
convergence criterion has been met, such as when the construction difference is 
1 0 within the construction tolerance, the computer system is ready to model the scanner 
with an actual sample (step 895). If not, such as when the construction difference is 
outside the construction tolerance, the computer system re-estimates the TRC and 
filter parameters in steps 875 and 880, and the process repeats until the construction 
difference is within the construction tolerance. Alternatively, the computer system 
1 5 also uses correction equations, such as stepwise multiple linear regression functions, 
to further refine the forward model predictions. 

Optional correction functions (shown as functions 525 in FIG. 5 A) are preferably 
used to refine the estimation of the forward model. While the actual physical process 
is not clearly understood, there may be channel interaction which the filter functions 
20 5 1 0 and TRCs 520 do not reflect. The correction functions 525 represent this 
postulated channel interaction. The correction functions are preferably 
multidimensional regression functions. The preferred regression correction functions 
may be formed as a linear combination of a set of predictor functions which are 
themselves functions of the TRC output values. Considering the red channel, the 
25 regression function may be written as: 



1=7 

where d= r is the corrected model output; d r , rfg, and d b are the TRC output values; 
fi(d r , d g , db) is the i-th predictor function; 9j is the z-th regression parameter; and 
N pre d is the number of predictor functions in the regression. The specification of the 
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form of the predictor functions is subjective. For example, when modeling RGB 
scanner output, the predictor functions could be selected to be: 





fj{d r , d g , db) 


= d r 




f 2 {d r , dg, db) 


= d g 
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Given a specification of the predictor functions, the regression parameters { /?/ } can 
be determined via a standard stepwise regression process such as that described by S. 
Weisberg in "Applied Linear Regression" Chapter 8, pl90ff, John Wiley and Sons, 

1 5 New York 1980. Stepwise regression with a 95% confidence level can be used with 
the digital values from the TRCs 520 and their combinations as the regression 
variables and the scanner RGB values from the scanner as the data to be fit. These 
correction functions 525 often have a dominant linear term indicating the forward 
model 500 accounts for most of the behavior of the scanner. Accordingly, each 

20 correction function 525 receives all the digital values from the TRCs 520 and 
generates an estimated digital value for the respective R, G, B channel. 

Photographic Printer Model 

The photographic printer model is an idealized printing apparatus for determining 
25 spectral properties of the exposure illuminant over time. The photographic printer 
model includes a printing illuminant, filters which may modify the printing 
illuminant, and an exposure schedule that specifies the durations and filter selections 
for a sequence of exposure periods. The printer model preferably also includes a color 
temperature component. 
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As shown in FIG. 9, in the photographic printer model 900, an exposure control 
905 receives a user-supplied exposure schedule and subtractive print filter 
transmittance spectra. The exposure control 905 applies the exposure schedule to the 
subtractive print filter transmittance spectra to derive print filter transmittance spectra 

5 over time. A parametric function 910, preferably a black body radiator model, 

receives an -illuminant-color -temperature to model.the printing illuminant with a print 

illuminant power spectrum. Alternatively, the printing illuminant may be represented 
by a measured or user-specified spectrum. The computer system multiplies 915 the 
print filter transmittance spectrum by the print illuminant power spectrum to calculate 

10 the exposure illuminant spectrum over time. 

As shown in FIG. 10, in a process 1000 of estimating the exposure illuminant 
spectrum over time, the computer system estimates the printing illuminant spectrum 
(step 1 005). As noted above, the printing illuminant spectrum may be a supplied 
spectrum or derived using a parametric model. The parametric black-body radiator 

15 model may be expressed as: 

1(K T) = 3.741 83 x 10- 16 A 5 (exp[0.014388/A7]-iy 1 

where T is the color temperature in °K, X represents wavelength, and / is the resulting 
20 illuminant spectrum. I(X> T) is preferably normalized to make the spectral power at 

560 nm equal to 1 or 100. A primary illuminant filter may be applied to the computed 
power spectrum to reduce the power in certain spectral ranges like the red or near 
infrared. This filter provides better emulation of real print illuminants while still 
allowing temperature variation using a single parameter. Commercial photo finishing 
25 equipment may have lamp house filters to adjust the printing beam's color 

temperature to compensate for differences in paper sensitivities. To control the 
temperature of the printing beam, the color temperature of the black-body radiator 
may be varied manually or an appropriate measured illuminant spectrum may be 
used. 
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The computer system estimates the illuminant filter transmittance spectra (step 
1010). The filter transmittance spectra are preferably measured from appropriate 
physical photographic printer filters. Illuminant filters in subtractive photographic 
printers may be dichroic filters with flat passbands and stopbands and steep transition 

5 bands to remove specific wavelength ranges from the printing illuminant. Additive 
printers may use red, green, and blue illuminants. The computer system preferably 
has the capability to emulate additive printing with a subtractive system by using 
pairwise combinations of cyan, magenta, and yellow filters to obtain the red, green, 
and blue exposures. Many techniques for modeling the exposure illuminant are 

10 possible, including parametric models and direct measurement of both additive and 
subtractive printing devices, filters, and illuminants. For example additive 
photographic printers may use red, green, and blue exposure illuminants. The selected 
technique preferably specifies the spectral content of the exposure illuminant over 
time. The resulting function is preferably a function of time and wavelength subject to 

1 5 user control. 

The computer system applies the illuminant filter transmittance spectra to the 
printing illuminant spectrum according to the exposure schedule to estimate the 
exposure illumination spectrum over time (step 1015). Accordingly, the exposure 
illumination spectrum has spectral properties that vary over time according to the 

20 exposure schedule. The exposure schedule specifies the time periods that each print 
filter would be switched into the primary printing beam during the course of an 
exposure in the modeled printer. The exposure schedule can specify zero or more 
filters for any time period. The exposure schedule functions as an interface for the 
user. The parameters of the exposure schedule are the same as those parameters which 

25 would be modified during manual or automatic color correction. 

An example 1 100 of an exposure schedule is shown in FIG. 11- In this example 
1 100, a subtractive printer is used in an additive printing mode with red, green, and 
blue exposure periods. The spectral power of the printing illuminant is constant 
within each exposure period, and is the product of the printing illuminant times the 

30 product of the active filter transmittances for the period. 
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Photographic Paper Model 

The photographic paper model represents the behavior of real photographic 
media, both in terms of the production of colored dyes through exposure and 
processing and in the colorimetric properties of the resulting dye-based image. The 
paper modeTincludes'spectral sensitivities of dye layers; preferably CM Y dye layers: ~ 
The paper model also includes parameters such as exposure-dye transfer 
characteristics, paper base reflectance, and dye absorption spectra of the paper. Each 
of these is measured directly, estimated, or derived from measurements. The 
estimation process may be iterative due to interdependence between some of these 
paper parameters. 

As shown in FIG. 12, in the photographic paper model 1200, the computer system 
multiplies 1205 the film transmittance spectrum from the scanner and film models, 
the exposure illumination spectrum from the photographic printer model, and paper 
spectral sensitivities. The computer system converts the spectral product to log 
integrated exposures 1210. The computer system then converts the log integrated 
exposures to dye concentrations 1215. The computer system supplies the dye 
concentrations to a print media model 1220. The print media model 1220 uses the 
paper reflectance spectrum and the dye absorption spectra to convert the supplied dye 
concentrations to the predicted reflectance spectrum for the modeled photographic 
print. 

Typical spectral sensitivity curves indicate the energy required to produce a 
specified density above "fog" on photographic paper at each wavelength in the visible 
spectrum. Manufacturers of photographic paper may supply these curves for their 
papers, and these supplied curves may or may not be weighted by the power spectrum 
of the exposure illuminant. Spectral sensitivity curves which have been normalized by 
the illuminant spectral power are referred to as "equi-energy sensitivities". 
Equi-energy sensitivity curves may be used in a manner analogous to color matching 
functions and indicate the way photographic paper "sees" an illuminated negative 
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20 



image. The model assumes the sensitivities do not vary with the level of exposure and 
fixed sensitivity curves provide acceptable predictions. 

Sensitivity curves based on iso-density contours are generally not desirable for 
spectral modeling of the media. Densitometers typically do not provide a 
5 photographic channel independent measure due to secondary absorptions of the 

photographic media's dyes. For example, secondary absorption may cause the cyan ^^^X^ 
dye to contribute to the magenta and yellow dyes' sensitivity values. This 
characteristic reduces the validity of the density-based sensitivity curves. Dye 
concentration, however, provides a channel independent measure for photographic 

1 0 media. Accordingly, the photographic paper model preferably uses equi-energy 
sensitivity curves that have been derived from iso-concentration contours. These 
concentration-based curves describe the energy required at each wavelength to 
, produce a specified dye concentration and are a truer and more desirable 
representation of the media's actual sensitivities. 

1 5 The photographic media's dye-exposure transfer characteristics describe the 

amount of dye produced for a given channel as a function of the log integrated 
exposure for that channel. The integrated exposure E x for a channel x may be 
expressed as: 



where T n (X) is the spectral transmittance of a color patch, e(A,() is the time- varying 
exposure illuminant, and S X (X) is the photographic paper sensitivity for channel x. If 
the spectrum of the exposure illuminant is constant within each of a sequence of 
25 exposure periods (e.g., a set specified by an exposure schedule), then the integrated 
exposure may be written as: 



30 
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where N p is the number of exposure periods, and e(A>i) and t exp l are the exposure 
illuminant spectrum and duration for the z-th exposure period, respectively. Log 
integrated exposure, H x is the log of the integrated exposure and may be expressed as: 

5 H x = log,^* 

Plots of dye concentration versus log integrated exposure for CMY channels are 
referred to as "C-/ogE" curves. C-logE curves preferably do not vary with changing 
exposure illumination as a direct consequence of the definition of the integrated 
10 exposure described above. As a result, the C-logE curves can be used for any 
exposure condition without re-calculation. 

C-logE curves are based on channel independent measures. Because C-logE 
concentration values vary between zero and each channel's maximum concentration, 
the concentration values may be normalized to 1 .0 by proper adjustment of the dye 
15 absorption spectra. The colorant mixing model is also based on dye concentration, as 
discussed below, and so C-logE curves allow a substantially direct computation of the 
reflectance of a sample color. 

The C-logE characteristics of processed photographic paper depend on 
development conditions, such as chemistry and temperature of the developer solution 
20 and development time. The photographic paper model represents these conditions at a 
single point in time. Unintentional variations in these conditions mean there may be 
differences between actual prints and model-based predictions. Intentional variations 
in development conditions may be modeled by adjusting the C-logE curves, either 
through replacement with alternative measured values or through parametric 
25 adjustments. A.E. Saunders describes such adjustments in "Fitting the Photographic 
Characteristic Curve: a Functional Equation Approach", Journal of Photographic 
Science, Vol. 41, 1993, pp. 186-93. 

The paper spectral sensitivities and C-logE curves describe the dye production 
process as a function of exposure. Specifically, the C-logE curves convert log 
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integrated exposures into concentration values. For a channel x, the C-logE function 
can be expressed as: 

conc x = C X (H X ) 

5 

where C x is the C-logE function represented in, for example, parametric or tabular 
form, H x is the log integrated exposure as described above, and conc x is the resulting 
dye concentration. 

Photographic materials such as paper and film can exhibit a behavior known as 
10 reciprocity failure. Reciprocity failure is a breakdown of the equal tradeoff between 
time and the intensity of the exposure illuminant. This reciprocity can be seen in the 
calculation of the integrated exposure £ x , described above. For very small values of 
exposure time or illuminant intensity, this tradeoff does not always hold exactly. This 
reciprocity failure can be modeled by adjusting the inputs and/or outputs of the 
15 C-logE calculation. Such modifications could be functions of log integrated exposure 
and exposure time. The functions could be implemented as parametric equations or 
lookup tables. For example, the C-logE function for a channel x could be modified to 
include such adjustments as: 

20 conc x = C x {H reCaX {H x , t x , 0 X )] 

where t x is the exposure time and H rec . x is a reciprocity failure adjustment function 
with 0 X as its parameter vector (or lookup table). 

The colorimetric properties of the dye amounts resulting from the C-logE 
25 calculations are preferably modeled with a Kubelka-Munk colorant mixing model and 
a Saunderson correction for surface refractive index differences. These colorimetric 
properties represent the predicted reflectance spectrum of the modeled photographic 
print and may be expressed as: 

/3 t (l-k>)(l-k 2 )R P (*) 
l-k 2 R P (*) 
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with 

R p (X) = R g (JL)txp[-2{cK C a) + mK M a) ^yKyW}] 

5 where X represents wavelength, c, m, and y are the dye concentrations as determined 

by the C-logE curves, e.g., m = Cm(Hm)- Kc(V> Km(V> Ky(X) are the 
photographic paper's normalized spectral dye absorptivities, determined by factor 
analysis similar to that for the film dyes described above in the scanner and film 
models. Rg(X) is the reflectance of the paper base, and R p (A) and R p >(X) are the 

10 uncorrected and corrected spectral reflectances of a color patch, respectively. Values 
used in the Saunderson correction are on the order of kj = 0.04 and #2 = 0.6, 
depending upon the medium. Accordingly, R p is the predicted reflectance 
spectrum of the modeled photographic print. 

Accordingly, the paper model performs the final calculation of the predicted 

1 5 reflectance spectrum. However, as noted above, the calculation could be performed in 
an alternate structure in a different implementation. For example, in an alternative 
implementation, the print model controls the overall execution and determination of 
the final predicted reflectance spectrum. The print model makes requests for 
calculations from the paper model, such as requesting the log integrated exposures be 

20 converted to concentrations and then requesting reflectance spectra for given 
concentrations. 

In one implementation, the photographic paper's dye absorption curves are 
determined in a manner similar to that of the film. Wedges which approximate steps 
in each of the paper's colorant channels are printed and the resulting prints and the 

25 paper base are measured with a spectrophotometer. The measured reflectance spectra 
are converted to absorption spectra using the equations for the colorimetric properties 
described in the photographic paper model. As with color negative film, producing 
single dye prints for determination of each dye's absorption spectrum is difficult. 
Hence, factor analysis with target rotation is applied to these absorption spectra to 

30 produce the desired absorption curves. Eigenvalues of the absorption spectra of the 
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step wedge for each colorant can be used as aim spectra in the target rotation, as noted 
above. 

In one implementation, to determine C-logE curves, a transmissive neutral step 
wedge is printed using the photographic printing process being modeled. A neutral 
5 step wedge has essentially gray samples in discrete steps from low density to high 
density. The reflectance spectra of the printed step wedge samples are measured, as 
are the transmission spectra of the neutral step wedge samples. Log integrated 
exposures for each transmissive wedge sample are found as described above. The 
paper's dye absorptivities are found and the dye concentrations are found for each 

10 printed sample using a colorant formulation process, such as that described by R.S. 
Berns in "Spectral modeling of a dye diffusion thermal transfer printer", Journal of 
Electronic Imaging, Vol. 2, No. 4, October 1993, pp. 359-70. For each colorant, the 
paired concentration and log integrated exposure values are input into a spline fitting 
function. The resulting splines are resampled with a uniform spacing. 

15 In one implementation, to derive the spectral sensitivities of the photographic 

paper, experimentally determined curves or estimates are used to initialize parameters 
of a search process for the best-fit sensitivities as described above. Because the 
C-logE curves depend on the spectral sensitivities for computation of log integrated 
exposure, the C-logE curves are updated as the sensitivities change. An iterative 

20 process of adjusting the sensitivities and then the C-logE curves is performed until a 
stopping criterion is met, such as when the curves sufficiently converge. 

Implementation 

The invention may be implemented in hardware or software, or a combination of 
25 both. However the invention preferably is implemented in computer programs 

executing on programmable computers each comprising a processor a data storage 
system (including volatile and nonvolatile memory and/or storage elements), at least 
one input device, and at least one output device. Program code is applied to input data 
to perform the functions described herein and generate output information. The output 
30 information is applied to one or more output devices, in known fashion. 
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Each such program may be implemented in any desired computer language 
(including machine, assembly, high level procedural, or object oriented programming 
languages) to communicate with a computer system. In any case, the language may be 
a compiled or interpreted language. 

5 Each such computer program is preferably stored on a storage media or device 

-{e.g., ROM, CDROM, or magnetic-media) readable by a general or special, purpose . 
programmable computer, for configuring and operating the computer when the 
storage media or device is read by the computer to perform the procedures described 
herein. The inventive system may also be considered to be implemented as a • 

1 0 computer-readable storage medium, configured with a computer program, where the 
storage medium so configured causes a computer to operate in a specific and : ;: 
predefined manner to perform the functions described herein. 

A number of implementations of the present invention have been described. 

1 5 Nevertheless, it will be understood that various modifications may be made without 
departing from the spirit and scope of the invention. Additional variations are 
possible, such as using CMY color space coordinates for the forward model instead of 
RGB color space coordinates. Alternatively, the models for the components {e.g., the 
negative, the dyes, the paper, etc.) can be selected from a database of available 

20 models. The filter functions can also be provided or measured directly. 
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WHAT IS CLAIMED IS: 

1. A method of modeling spectral characteristics of a photographic print based on a 
photographic negative, comprising: 



transmittance spectrum using a photographic negative film model corresponding to a 
media of the photographic negative; 



converting the integrated spectral products into log integrated exposures; 
converting the log integrated exposures to dye concentrations; and 
converting the dye concentrations to a predicted reflectance spectrum. 

2. The method of claim 1 , where converting digital values to a film transmittance 
spectrum comprises: 

iteratively updating media coordinates corresponding to an estimated spectrum 
until a stopping criterion is met, where the media coordinates are in a colorant space 
of a sample scanned by an image acquisition device; and 

constraining said updating using a media model corresponding to the sample with 
a constrained minimization process. 



converting digital values from scanning a photographic negative to a film 





integrating over time spectral products of the film transmittance spectrum, the 
exposure illumination spectrum, and the paper spectral sensitivities; 
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3. The method of claim 1 , where converting digital values to a film transmittance 
spectrum comprises: 

(a) estimating media coordinates in a colorant space of the photographic negative 
scanned by an image acquisition device, where the estimated media 

5 coordinates correspond to target digital values produced by the image 

. ... . .acquisition device when scanning the photographic negative; 

(b) converting the estimated media coordinates to an estimated spectrum using a 
photographic negative film model corresponding to the photographic 
negative; 

1 0 (c) estimating digital values by supplying the estimated spectrum to a forward 

model which models the image acquisition device; 

(d) identifying a film error between the estimated digital values and the target 
digital values; and 

(e) if a stopping criterion has not been met, searching the colorant space for 

1 5 media coordinates according to the film error and repeating steps (b) through 

(e) until the stopping criterion has been met. 

4. The method of claim 3, where: 

the media coordinates for the photographic negative film model represent dye 
20 concentrations of cyan; magenta, and yellow dyes; and 

the media coordinates which produce the film error within the film tolerance form 
the film transmittance spectrum. 



25 



5. The method of claim 3, where said searching the colorant space includes using a 
numerical minimization technique constrained so as not to identify media coordinates 
outside bounds corresponding to the photographic negative. 
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6. The method of claim 3, where the image acquisition device has at least one output 
channel, and the forward model comprises, for each output channel of the image 
acquisition device: 

multiplying a sample spectrum supplied to the forward model and a value of a 
5 filter function to produce a spectral product, where the value of the filter function 
represents a product of a filter transmittance spectrum corresponding to a filter of the 
image acquisition device and an illuminant spectrum corresponding to an illuminant; 

integrating the spectral product over at least one wavelength to produce an 
integral value; and 

10 converting the integral value into an estimated digital value by applying a 

one-dimensional transformation function to the integral value. 

7. The method of claim 6, where the spectral product is integrated over the visible 
wavelengths. 

15 

8. The method of claim 6, further comprising: 

applying a multidimensional regression function to the estimated digital values to 
model channel interaction in the image acquisition device. 

20 9. The method of claim 6 5 wherein the one-dimensional transformation function is a 
gain-offset-gamma function, the method further comprising estimating parameters of 
the gain-offset-gamma function, where such estimation comprises: 

scanning a flat spectra target to produce flat sample values, where the flat spectra 
target includes a neutral color wedge such that spectra are substantially constant at 
25 each visible wavelength; 

measuring flat sample spectra of the flat spectra target; and 
estimating gain, offset, and gamma parameters based upon the flat sample values 
and the flat sample spectra using a constrained minimization technique. 
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10. The method of claim 6, further comprising estimating filter parameters of the 
filter function, where such estimation comprises: 

scanning a multicolor target to produce multicolor sample values, where the 
multicolor target includes colors spanning a gamut of a printing device which 
5 produced the multicolor target; 

measuring multicolor sample spectra of 'the multicolor target; - ~ 

estimating filter parameters of the filter function based on the multicolor sample 
values and the multicolor sample spectra using a constrained minimization technique; 
calculating filter digital values by supplying the multicolor sample spectra to the 
1 0 forward model and using the estimated filter functions; 

calculating a filter difference by comparing the filter digital values to the 
multicolor sample values; and 

if a filter stopping criterion has not been met, re-estimating the filter parameters 
based on the filter difference and repeating the steps of calculating filter digital 
15 values, calculating the filter difference, and re-estimating the filter parameters until 
the filter stopping criterion has been met. 

11. The method of claim 10, where the one-dimensional transformation function is a 
gain-offset-gamma function, and the method further comprises: 

20 estimating gain-offset-gamma parameters for the gain-offset-gamma function; 

calculating construction digital values using the gain-offset-gamma function and 
filter function with the respective estimated parameters; 

calculating a construction difference based on the construction digital values and 
the multicolor sample values; and 
25 if a convergence criterion has not been met, re-estimating the gain-offset-gamma 

parameters and the filter parameters until the convergence criterion is met. 
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1 2. The method of claim 1 1 , where estimating gain-offset-gamma parameters 
comprises: 

scanning a flat spectra target to produce flat sample values, where the flat spectra 
target includes a neutral color wedge such that spectra are substantially constant at 
5 each visible wavelength; 

measuring flat sample spectra of the flat spectra target; and 

estimating gain, offset, and gamma parameters based upon the flat sample values 
and the flat sample spectra using a constrained minimization technique. 

10 13. The method of claim 6, where the one-dimensional transformation function is a 
gain-offset-gamma function, and the method further comprises: 

scanning a flat spectra target to produce flat sample values, where the flat spectra 
target includes a neutral color wedge such that spectra are substantially constant at 
each visible wavelength; 
1 5 measuring flat sample spectra of the flat spectra target; 

scanning a multicolor target to produce multicolor sample values, where the 
multicolor target includes colors spanning a gamut of a printing device which 
produced the multicolor target; 

measuring multicolor sample spectra of the multicolor target; 
20 determining flat average values based on the flat sample values; 

estimating gain-offset-gamma parameters for the gain-offset-gamma function 
based on the flat average values and the flat sample spectra using constrained 
minimization; 

estimating filter parameters for the filter functions based on the multicolor sample 
25 values and the multicolor sample spectra using constrained minimization; 

re-estimating the gain-offset-gamma parameters using the flat sample spectra; 
re-estimating the filter parameters using the re-estimated gain-offset-gamma 
functions; 
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calculating construction digital values using the gain-offset-gamma function and 
filter function with the respective re-estimated parameters based on the multicolor 
sample spectra; 

calculating a construction difference based on the construction digital values and 
5 the multicolor sample values; and 

if a convergence criterion has not been met," re -estimating the "gain-offset-gamma 
parameters and the filter parameters until the convergence criterion is met. 

1 4. The method of claim 6, where the image acquisition device has at least one 
10 output channel, and the forward model comprises, for each output channel of the 

image acquisition device: 

multiplying a sample spectrum supplied to the forward model and an illuminant 
spectrum corresponding to an illuminant to produce a first spectral product; 

multiplying the first spectral product by a filter transmittance spectrum 
15 corresponding to a filter of the image acquisition device to produce a second spectral 
product; 

integrating the second spectral product over at least one wavelength to produce an 
integral value; and 

converting the integral value into an estimated digital value by applying a 
20 one-dimensional transformation function to the integral value. 

15. The method of claim 1, where estimating an exposure illumination spectrum 
comprises: 

estimating a printing illuminant spectrum; 
25 estimating illuminant filter transmittance spectra which modify the printing 

illuminant; 

applying the estimated illuminant filter transmittance spectra to the printing 
illuminant spectrum according to an exposure schedule, where the exposure schedule 
specifies durations and filter selections for at least one exposure period. 

30 
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16. The method of claim 15, where the exposure schedule specifies at least one time 
period where at least one illuminant filter is exposed to the printing illuminant. 

1 7. The method of claim 1 5, where the printing illuminant spectrum is a measured 
5 spectrum of an illuminant. 

1 8 . The method of claim 15, where the printing illuminant spectrum is derived from 
one of a parametric model and a black-body radiator model. 

10 19. The method of claim 15, where the illuminant filter transmittance spectra model 
filters of one of a subtractive photographic printing device and an additive 
photographic printing device. 

20. The method of claim 1 , where the paper spectral sensitivities are equi-energy 
1 5 sensitivity curves derived from iso-concentrations contours and describe energy 

required at each wavelength to produce a specified dye concentration in the 
photographic paper. 

2 1 . The method of claim 1 , where the paper spectral sensitivities include 

20 dye-exposure transfer characteristics which describe an amount of dye produced for a 
given channel as a function of the log integrated exposure for that channel. 

22. The method of claim 1 , further comprising estimating dye absorption curves for 
the photographic paper, where estimating the dye absorption curves comprises: 

25 measuring a paper base spectrum of the photographic paper; 

measuring a paper target spectrum of a paper target having steps in each of the 
photographic paper's colorant channels; 
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converting the paper base spectrum and the paper target spectrum to absorption 
spectra; and 

applying factor analysis and target rotation to the absorption spectra to produce 
dye absorption curves. 

5 

23 . The method of claim 1 , further comprising determining C-ldgE curves which are 
plots of dye concentration versus log integrated exposure for colorant channels, and 
determining C-logE curves comprises: 

printing a neutral step wedge having gray samples in substantially discrete steps 
1 0 from low to high density on the photographic paper; 

measuring curve reflectance spectra of the samples of the printed neutral step 
wedge; 

measuring curve transmissive spectra of the samples of the printed neutral step 
wedge; 

1 5 determining a log integrated exposure for each sample of the printed neutral step 

wedge; 

determining dye absorptivities of the photographic paper; 

determining dye concentrations for each sample of the printed neutral step wedge 
using the determined dye absorptivities; 
20 applying a spline fitting function to paired dye concentrations and log integrated 

exposures to produce splines; and 

resampling the splines with uniform spacing to produce the C-logE curves. 

24. A method of predicting a reflectance spectrum of a photographic print based on a 
25 photographic negative, comprising: 

estimating a film spectral transmittance of a photographic negative; 
estimating an exposure illumination spectrum of a printing illuminant over time; 
estimating spectral sensitivities of photographic paper corresponding to the 
photographic print; 
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estimating dye concentrations based on the film spectral transmittance, the 
exposure illumination spectrum, and the spectral sensitivities; 

converting the estimated dye concentrations to a predicted reflectance spectrum of 
the photographic print corresponding to the photographic negative. 

25. A computer program, residing on a computer-readable medium, for modeling 
spectral characteristics of a photographic print based on a photographic negative, the 
computer program comprising instructions for causing a computer to execute the 
method of any of claims 1-24. 



-36- 



WO 01/01672 



PCT/US00/15469 



100- 



1/14 



110- 



105- 



115- 



TARGET 
VALUES' 



SCANNER 
AND FILM 
MODELS 



PHOTOGRAPHIC 
PRINTER MODEL 



PHOTOGRAPHIC 
PAPER MODEL 



PHOTOGRAPHIC 
PAPER SPECTRAL 
SENSITIVIES 



EXPOSURE 
SCHEDULE 



ESTIMATED 
SPECTRUM 



FIG. 1 



WO 01/01672 



PCT/USOO/15469 



2/14 



■200 



205- 



210- 



215- 



220- 



CONVERT DIGITAL VALUES TO 
FILM TRANMITTANCE SPECTRUM 




f 


ESTIMATE EXPOSURE 
ILLUMINATION SPECTRUM 




f 


ESTIMATE PAPER SPECTRAL 
SENSITIVITIES 


\ 1 


f 



INTEGRATE SPECTRAL 
PRODUCTS OF FILM 
TRANS MITTANCE SPECTRUM, 

EXPOSURE ILLUMINATION 
SPECTRUM, PAPER SPECTRAL 
SENSITIVITIES 



225- 



230- 



235- 







CONVERT TO EXPOSURE 
DENSITIES 




r 


CONVERT TO DYE 
CONCENTRATIONS 




f 


CONVERT TO PREDICTED 
REFLECTANCE SPECTRUM 



FIG. 2 



WO 01/01672 



PCT/US00/15469 



3/14 



a 

UJ 




o 




■z>- 



^ O 
H UJ 
CO 0- 

uj co 



T 



< 


I 

UJ 


Q 


Q 


LU 


O 






i 




X 


UJ 


O Z 


< 


o 


LU 


z: 


C/) 


LU 








o 


cc 




LU 




CO 

CD 



I - CO 
LU LU ^ 
O Z> O 

5 3* ^ 
<<U_ 



LU 

cc > 
O I— 

-J < 

O CD 
O LU 



WO 01/01672 



PCT/US00/15469 



4/14 




ESTIMATE MEDIA 
COORDINATES USING 
TARGET DIGITAL 
VALUES 



470- 



CONVERT TO 
ESTIMATED 
SPECTRUM USING 
MEDIA MODEL 



475- 



CONVERT TO 
ESTIMATED DIGITAL 
VALUES USING 
FORWARD MODEL 



420- 



CALCULATE ERROR 

BETWEEN 
ESTIMATED DIGITAL 
VALUES AND TARGET 
DIGITAL VALUES 



425- 



/ STOPPING \ 
I CRITERIA MET J 



1 


f f 


430 


UPDATE MEDIA 




COORDINATES IN 




COLORANT SPACE 




BASED ON ERROR 





FIG. 4 



WO 01/01672 



PCT/USOO/15469 



5/14 



•500 



SAMPLE 
SPECTRUM 



510 



1 



505- 



515- 



570—. 505- 



515- 



510—^ 505- 



515- 



INTE GRATE 



520- 





r 


TRC R 



INTEGRATE 



520- 



^ ■ 




TR 





INTEGRATE 



520- 



52 



525- 



CORRECTION R 





r 


TRC B 



1 



525- 



CORRECTION G 



CORRECTION, 



ESTIMATED 
DIGITAL 
VALUEo 



ESTIMATED 
DIGITAL 
VALUE G 



ESTIMATED 
DIGITAL 
VALUE B 



FIG. 5A 



WO 01/01672 



PCT/US00/15469 



6/14 

SAMPLE SPECTRUM 
-552 



ILLUMINANT 
SPECTRUM ' 



560 



1 



555- 



560-^ 555- 



565- 



■550 



560—^ 555' 



X 



565 



INTEGRATE 



570- 



S ■ 


f 


TRC R 



B 



56 



5 ^ 1 



INTEGRATE 



570- 





r 


TRC G 



INTEGRATE 



570- 



575- 



575- 



CORRECTION c 





f 


TRC B 



575- 



CORRECTION, 



CORRECTION, 



ESTIMATED 
DIGITAL 
VALUE D 



ESTIMATED 
DIGITAL 
VALUE- 



ESTIMATED 
DIGITAL 
VALUE B 



FIG. 5B 



WO 01/01672 



PCT/US00/15469 



7/14 



■600 



605 



SCAN FLAT SPECTRA 
TARGET. 






MEASURE FLAT 
SPECTRA 


610^ 




ESTIMATE 
PARAMETERS OF TRC 
FUNCTIONS 







SCAN MULTICOLOR 
TARGET 



620 



MEASURE SPECTRA 
OF MULTICOLOR 
TARGET 



625 



ESTIMATE 
PARAMETERS OF 
FILTER FUNCTIONS 



630 



CALCULATE FILTER 
DIGITAL VALUES 






CALCU LA- 
DIFFER 


TE FILTER 
ENCES 



635 




650 



RE-ESTIMATE 
FILTER FUNCTION 
PARAMETERS 



FIG. 6 



WO 01/01672 



PCT/US00/15469 



8/14 




400 440 480 520 560 600 640 680 



wavlength,\ 

FIG. 7 



WO 01/01672 



PCT/USOO/15469 



9/14 



■800 



805- 



INITIALIZE 
PARAMETERS OF TRC 
FUNCTIONS 



810- 



INITIALI2E 
PARAMETERS OF 
FILTER FUNCTIONS 



875- 



820- 



825- 




CALCULATE DIGITAL 

VALUES USING 
ESTIMATED TRC AND 
FILTER FUNCTIONS 



CALCULATE ERROR 



830- 



RE-ESTIMATE 
PARAMETERS OF TRC 
FUNTIONS 



CONVERGENCE \ 
CRITERIA MET J 



835 



RE-ESTIMATE 
PARAMETERS OF 
FILTER FUNTIONS 



FIG. 8A 



WO 01/01672 



PCT/US00/15469 



10/14 



■850 



855- 



860- 



865- 



870- 



875- 



880- 



885- 



895 

_!_ 



CONVERGENCE 
CRITERIA MET 



SCAN AND MEASURE 
TRAINING TARGETS 



DETERMINE 
AVERAGE VALUES 
FOR TRC TRAINING 
SPECTRA 



ESTIMATE TRC 
PARAMETERS USING 
AVERAGE VALUES 



DERIVE PARAMETERS 
OF FILTER 
FUNCTIONS 



RE-ESTIMATE 
PARAMETERS OF TRC 
FUNCTIONS 



RE-ESTIMATE 
PARAMETERS OF 
FILTER FUNCTIONS 



CALCULATE DIGITAL 

VALUES USING 
ESTIMATED TRC AND 
FILTER FUNCTIONS 




FIG. 8B 



WO 01/01672 



PCT/US00/15469 



11/14 



900- 



ILLUMINANT 
COLOR 
TEMPERATURE 



SUBTRACTIVE PRINT 
FILTER 
TRANSMITTANCE 
SPECTRA 



910- 



905- 



BLACK BODY 
RADIATOR 
MODEL 



915-^ 



X 



EXPOSURE 
CONTROL 



EXPOSURE 
SCHEDULE 



EXPOSURE 
ILLUMINATION 
SPECTRUM OVER 
TIME 



FIG. 9 



WO 01/01672 



PCT/US00/15469 



12/14 



1000 



1005- 



1010- 



ESTIMATE PRINTING 
ILLUMINANT 
SPECTRUM 



ESTIMATE 
ILLUMINANT FILTER 
SPECTRA 



1015- 



APPLY ILLUMINANT 
FILTER SPECTRA TO 
PRINTING 
ILLUMINANT 
SPECTRUM 
ACCORDING TO 
EXPOSURE 
SCHEDULE 



FIG. 10 



WO 01/01672 



PCT/US00/15469 



13/14 



1100 



PERIOD 


DURATION (ms) 


FILTERING 


CYAN 


MAGENTA 


YELLOW 


1 


1.485401 


OUT 


IN 


IN 


2 


3.769730 


IN 


OUT 


IN 


3 


7.296930 


IN 


IN 


OUT 



FIG. 11 



WO 01/01672 



PCT/US00/15469 



14/14 



1200 



PAPER 
SPECTRAL 
SENSITIVITIES 



1205- 



FILM 
TRANSMITTANCE 
SPECTRUM 

1210- 



EXPOSURE 
ILLUMINATION 
SPECTRUM OVER 
TIME 



EXPOSURE 
DENSITIES 



1215- 



DYE 

CONCENTRATIONS 



1220- 



PAPER DYE 
ABSORPTION 
SPECTRA 



PRINT MEDIA MODEL 



PREDICTED REFLECTANCE 
SPECTRUM OF PHOTOGRAPHIC 
PRINT 



FIG. 12 



INTERNATIONAL SEARCH REPORT 


Inte onat Application No 

PCT/US 00/15469 


IPC 7 H04N1/60 




According to International Patent Classification (IPC) or to both national classification and IPC 




B. FIELDS SEARCHED 


Minimum documentation searched (classification system followed by classification symbols) 

IPC 7 H04N 



Documentation searched other than minimum documentation to the extent mat such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and. where practical, search terms used) 

EPO-Internal 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


Y 
Y 


US 5 790 280 A (TERASHITA TAKAAKI) 
4 August 1998 (1998-08-04) 

column 5, line 51 -column 6, line 42 
column 7, line 28 -column 8, line 30; 
figures 2,3 

US 5 521 723 A (MADDEN THOMAS E ET AL) 
28 May 1996 (1996-05-28) 

abstract; figures 3,6,12 

column 3, line 7 -column 6, line 53 

-/— 


1-3,6-8, 

14,15, 

24,25 

1-3,6-8, 

14,15, 

24,25 


X Furt 


her documents are listed in the continuation of box C. [x | Patent family members are listed in annex. 


• Special categories of cited documents : -j- , ater document published after the international Sing date 

or priority date and not in conflict with the application but 
"A" document defining the general state of the art which is not citecJ t0 understand the principle or theory underlying the 

considered to be of particular relevance invention 
"E" earlier document but published on or after the international - x - document of particular relevance: the claimed invention 

filing date cannot be considered novel or cannot be considered to 
■L" document which may throw doubts on priority claim(s) or involve an inventive step when the document is taken alone 

which is cited to establish the publication date of another .y. document of particular relevance; the claimed invention 

citation or other special reason (as specified) cannot be considered to involve an inventive step when the 
*0" document referring to an oral disclosure, use, exhibition or document is combined with one or more other such docu- 

other means ments. such combination being obvious to a person skilled 

■P" document published prior to the international filing date but ,n the art ' 

later than the priority date claimed *&' document member of the same patent family 


Date of the actual completion of the international search 

7 September 2000 


Date of mailing of the international search report 

19/09/2000 


Name and mailing address of the ISA 

European Patent Office, P.B. 5818 Patentlaan 2 
NIL - 2280 HV Rijswijk 
Tel. (+31-70) 3^0-2040. Tx. 31 651 epo nl. 
Fax: (+31-70) 340-3016 


Authorized officer 

Kassow, H 



Form PCT71S/U210 (second sheet) (July 1902) 



page 1 of 3 



INTERNATIONAL SEARCH REPORT 



tnti tonal Application No 

PCT/US 00/15469 



C(Conttnuatton) DOCUMENTS CONSIDERED TO BE RELEVANT 




Category * 


Citation of document, with indication.where appropriate, of tne relevant passages 


Relevant to claim No. 


A 


US 5 255 083 A (CARLUCCI JOHN ET AL) 


1,3,4,6, 




19 October 1993 (1993-10*19) 


8,9,23 




column 7 line 52 -column 8, line 3 






column 5, 1 ine 20 - 1 ine 56 






column 2, line 23 - line 45 






abstract 




A 


US 4 970 584 A (SATO Y0JIR0 ET AL) 


3,6 




13 November 1990 (1990-11-13) 






column 5, 1 ine 57 - 1 ine 68 






column 1, line 22 - line 26 




A 


— 

US 5 157 506 A (HANNAH ERIC C) 


9,10,12, 




20 October 1992 (1992-10-20) 


13 




column 9, line 52 -column 10, line 16; 






f i nil rp ft 






column 11, line 53 - line 63 




A 




US 4 658 286 A (SCHWARTZ JACK ET AL) 


6,13 




14 April 1987 (1987-04-14) 






column 3, line 40 - line 49 






rnlumn 4 line 51 -column 5. line 18 

\J 1 U | III I T , 1 III W vmt A. W V 1 Willi 1 f ■ » ■ ■ » * 






column 8, line 65 -column 9, line 28 






column 13, line 62 -column 14, line 9 




A 


US 4 975 737 A (MUROOKA TAKASHI ET AL) 


4,23 




4 December 1990 (1990-12-04) 






column 1, line 50; figure 1 






column 3, line 55 - line 58 






column 6, line 3 -column 7, line 14 




A 


W0 89 03062 A (EASTMAN KODAK CO; 


1,2, 




6 April 1989 (1989-04-06) 


15-17, 




21-25 




abstract; figures 1-8 






page 2 -page 3 






page 4, line 17 -page 5 






page 7 -page 8, line 16 






Daae 9 line 6 - line 17 






page 13, line 7 -page 14, line 13 






page 15 -page 16 

— — 




A 


US 5 337 130 A (SAT0H YASUAKI ) 


1,15 




9 August 1994 (1994-08-09) 






column 6, line 20 - line 39 






column 12, line 55 -column 13, line 5 






rnlumn 1? line 45 - line 56 




A 


BUCHSBAUM G: "A SPATIAL PROCESSOR MODEL 






FOR OBJECT COLOUR PERCEPTION" 






JOURNAL OF THE FRANKLIN 






INSTITUTE, US, PERGAM0N PRESS, ELMSFOR, NY, 






vol. 310, no. 1, 1 July 1980 (1980-07-01), 






! pages 1-27, XP000195823 






ISSN: 0016-0032 






-/~ 





Form PCT/ISAV210 (continuation o* second sheet) (Juty 1992) 



page 2 of 3 



INTERNATIONAL SEARCH REPORT ^ looal App(lcatten ^ 

PCT/US 00/15469 


C(Conthiuatlbn) DOCUMENTS CONSIDERED TO BE RELEVANT 


Category" 1 


Citation of document with indication, where appropriate, of the relevant passages 




A 1 

A 


CHUNG P -C: "C0LORIMETRIC CALIBRATIO FOR 
SCANNERS AND MEDIA" 
PROCEEDINGS OF THE SPIE, 
27 February 1991 (1991-02-27), 
XP000616908 

- the whole document . .. .. . 

JUNG N ET AL: "AN ALTERNATIVE METHOD OF 
OPTOELECTRONIC COLOR ANALYSIS FOR SLIDES" 
SIGNAL PROCESSING. IMAGE 
COMMUNICATION.NL, ELSEVIER SCIENCE 
PUBLISHERS, AMSTERDAM, 

vol. 6, no. 1, 1 March 1994 (1994-03-01), 
pages 47-57, XP000429150 
ISSN: 0923-5965 


2 



Form PCT/lSA^lO (oonnnuation ol second sheet) (July 1992) 



page 3 of 3 



INTERNATIONAL SEARCH REPORT 

.nf ortnatton on patent family mom bora 


Inte onai t 

PCT/US 


Application No 
00/15469 


Patent document 
cited in search report 


Publication 
date 


Patent family 
members) 


Publication 
date 



US 5790280 A 04-08-1998 JP 9051433 A 18-02-1997 

JP 9065139 A 07-03-1997 



US 5521723 A 28-05-1996 NONE 



US 5255083 A 19-10-1993 JP 5260500 A 08-10-1993 

US 5646750 A 08-07-1997 



US 4970584 


A 


13-11-1990 


JP 


61261970 


A 


20-11-1986 






JP 


61261971 


A 


20-11-1986 








JP 


61296858 


A 


27-12-1986 


US 5157506 


A 


20-10-1992 


US 


5148288 


A 


15-09-1992 






WO 


9204803 


A 


19-03-1992 


US 4658286 


A 


14-04-1987 


NONE 








US 4975737 


A 


04-12-1990 


JP 


2184837 


A 


19-07-1990 






JP 


2660568 


B 


08-10-1997 


W0 8903062 


A 


06-04-1989 


DE 


3788656 


D 


10-02-1994 






DE 


3788656 


T 


14-07-1994 








EP 


0381668 


A 


16-08-1990 


US 5337130 


A 


09-08-1994 


JP 


5045745 


A 


26-02-1993 






DE 


4226218 


A 


11-02-1993 



Form PCT/lSA/210 (patent tarrdy annex) (July 1992) 



0 •-" 



THIS PAGE BUNK (ospto) 



